Pandas Profiling Report

Dataset statistics

Number of variables	10
Number of observations	737
Missing cells	417
Missing cells (%)	5.7%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	57.7 KiB
Average record size in memory	80.2 B

Variable types

Numeric	9
Categorical	1

Warnings

`Pregnancies` is highly correlated with `Age`	High correlation
`Glucose` is highly correlated with `Insulin`	High correlation
`SkinThickness` is highly correlated with `BMI`	High correlation
`Insulin` is highly correlated with `Glucose`	High correlation
`BMI` is highly correlated with `SkinThickness`	High correlation
`Age` is highly correlated with `Pregnancies`	High correlation
`Pregnancies` is highly correlated with `Age`	High correlation
`Glucose` is highly correlated with `Insulin`	High correlation
`SkinThickness` is highly correlated with `BMI`	High correlation
`Insulin` is highly correlated with `Glucose`	High correlation
`BMI` is highly correlated with `SkinThickness`	High correlation
`Age` is highly correlated with `Pregnancies`	High correlation
`DiabetesPedigreeFunction` is highly correlated with `BMI`	High correlation
`Pregnancies` is highly correlated with `Age`	High correlation
`Glucose` is highly correlated with `Insulin` and 1 other fields	High correlation
`Insulin` is highly correlated with `Glucose`	High correlation
`SkinThickness` is highly correlated with `BMI`	High correlation
`BMI` is highly correlated with `DiabetesPedigreeFunction` and 1 other fields	High correlation
`Age` is highly correlated with `Pregnancies`	High correlation
`Outcome` is highly correlated with `Glucose`	High correlation
`BloodPressure` has 47 (6.4%) missing values	Missing
`Insulin` has 356 (48.3%) missing values	Missing
`Age` has 14 (1.9%) missing values	Missing
`df_index` has unique values	Unique
`Pregnancies` has 108 (14.7%) zeros	Zeros

Reproduction

Analysis started	2021-05-12 16:38:24.112812
Analysis finished	2021-05-12 16:38:37.746811
Duration	13.63 seconds
Software version	pandas-profiling v3.0.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	737
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	389.7367707

Minimum	0
Maximum	767
Zeros	1
Zeros (%)	0.1%
Negative	0
Negative (%)	0.0%
Memory size	5.9 KiB

Quantile statistics

Minimum	0
5-th percentile	37.8
Q1	206
median	393
Q3	581
95-th percentile	730.2
Maximum	767
Range	767
Interquartile range (IQR)	375

Descriptive statistics

Standard deviation	221.277169
Coefficient of variation (CV)	0.5677605646
Kurtosis	-1.176693528
Mean	389.7367707
Median Absolute Deviation (MAD)	188
Skewness	-0.04454773998
Sum	287236
Variance	48963.58551
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	0.1%
524	1	0.1%
514	1	0.1%
515	1	0.1%
516	1	0.1%
517	1	0.1%
518	1	0.1%
519	1	0.1%
520	1	0.1%
521	1	0.1%
Other values (727)	727	98.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	0.1%
1	1	0.1%
2	1	0.1%
3	1	0.1%
4	1	0.1%
5	1	0.1%
6	1	0.1%
7	1	0.1%
8	1	0.1%
10	1	0.1%

Value	Count	Frequency (%)
767	1	0.1%
766	1	0.1%
765	1	0.1%
764	1	0.1%
763	1	0.1%
762	1	0.1%
761	1	0.1%
760	1	0.1%
759	1	0.1%
758	1	0.1%

Pregnancies
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	16
Distinct (%)	2.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.829036635

Minimum	0
Maximum	15
Zeros	108
Zeros (%)	14.7%
Negative	0
Negative (%)	0.0%
Memory size	5.9 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	3
Q3	6
95-th percentile	10
Maximum	15
Range	15
Interquartile range (IQR)	5

Descriptive statistics

Standard deviation	3.350547209
Coefficient of variation (CV)	0.8750366027
Kurtosis	0.007999414434
Mean	3.829036635
Median Absolute Deviation (MAD)	2
Skewness	0.8736186517
Sum	2822
Variance	11.2261666
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=16)

Value	Count	Frequency (%)
1	129	17.5%
0	108	14.7%
2	97	13.2%
3	74	10.0%
4	66	9.0%
5	54	7.3%
6	48	6.5%
7	43	5.8%
8	36	4.9%
9	26	3.5%
Other values (6)	56	7.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	108	14.7%
1	129	17.5%
2	97	13.2%
3	74	10.0%
4	66	9.0%
5	54	7.3%
6	48	6.5%
7	43	5.8%
8	36	4.9%
9	26	3.5%

Value	Count	Frequency (%)
15	1	0.1%
14	2	0.3%
13	10	1.4%
12	9	1.2%
11	11	1.5%
10	23	3.1%
9	26	3.5%
8	36	4.9%
7	43	5.8%
6	48	6.5%

Glucose
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	135
Distinct (%)	18.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	121.8331072

Minimum	44
Maximum	199
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	5.9 KiB

Quantile statistics

Minimum	44
5-th percentile	80
Q1	100
median	117
Q3	141
95-th percentile	181
Maximum	199
Range	155
Interquartile range (IQR)	41

Descriptive statistics

Standard deviation	30.50980937
Coefficient of variation (CV)	0.2504229767
Kurtosis	-0.2725405002
Mean	121.8331072
Median Absolute Deviation (MAD)	20
Skewness	0.5424779303
Sum	89791
Variance	930.8484676
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	17	2.3%
99	16	2.2%
111	14	1.9%
129	14	1.9%
108	13	1.8%
106	13	1.8%
125	13	1.8%
95	13	1.8%
112	13	1.8%
122	12	1.6%
Other values (125)	599	81.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
44	1	0.1%
56	1	0.1%
57	1	0.1%
61	1	0.1%
62	1	0.1%
65	1	0.1%
67	1	0.1%
68	3	0.4%
71	4	0.5%
72	1	0.1%

Value	Count	Frequency (%)
199	1	0.1%
198	1	0.1%
197	4	0.5%
196	3	0.4%
195	2	0.3%
194	3	0.4%
193	2	0.3%
191	1	0.1%
190	1	0.1%
189	4	0.5%

BloodPressure
Real number (ℝ_≥0)

MISSING

Distinct	46
Distinct (%)	6.7%
Missing	47
Missing (%)	6.4%
Infinite	0
Infinite (%)	0.0%
Mean	72.26521739

Minimum	24
Maximum	122
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	5.9 KiB

Quantile statistics

Minimum	24
5-th percentile	52
Q1	64
median	72
Q3	80
95-th percentile	92
Maximum	122
Range	98
Interquartile range (IQR)	16

Descriptive statistics

Standard deviation	12.42022236
Coefficient of variation (CV)	0.1718699923
Kurtosis	0.9051929048
Mean	72.26521739
Median Absolute Deviation (MAD)	8
Skewness	0.1293096436
Sum	49863
Variance	154.2619234
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=46)

Value	Count	Frequency (%)
70	55	7.5%
74	47	6.4%
72	42	5.7%
68	42	5.7%
78	41	5.6%
76	39	5.3%
64	39	5.3%
60	36	4.9%
80	36	4.9%
62	34	4.6%
Other values (36)	279	37.9%
(Missing)	47	6.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
24	1	0.1%
30	2	0.3%
38	1	0.1%
40	1	0.1%
44	4	0.5%
46	2	0.3%
48	4	0.5%
50	13	1.8%
52	10	1.4%
54	11	1.5%

Value	Count	Frequency (%)
122	1	0.1%
114	1	0.1%
110	2	0.3%
108	2	0.3%
106	3	0.4%
104	2	0.3%
102	1	0.1%
100	3	0.4%
98	3	0.4%
96	3	0.4%

SkinThickness
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	51
Distinct (%)	6.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	29.09596929

Minimum	7
Maximum	99
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	5.9 KiB

Quantile statistics

Minimum	7
5-th percentile	14
Q1	25
median	29.09596929
Q3	32
95-th percentile	44
Maximum	99
Range	92
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	8.814606327
Coefficient of variation (CV)	0.3029493961
Kurtosis	5.607054474
Mean	29.09596929
Median Absolute Deviation (MAD)	3.90403071
Skewness	0.8473838871
Sum	21443.72937
Variance	77.69728469
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
29.09596929	216	29.3%
32	29	3.9%
30	27	3.7%
27	23	3.1%
33	20	2.7%
23	20	2.7%
18	20	2.7%
28	19	2.6%
31	19	2.6%
39	18	2.4%
Other values (41)	326	44.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
7	2	0.3%
8	2	0.3%
10	5	0.7%
11	6	0.8%
12	7	0.9%
13	11	1.5%
14	6	0.8%
15	13	1.8%
16	6	0.8%
17	13	1.8%

Value	Count	Frequency (%)
99	1	0.1%
63	1	0.1%
60	1	0.1%
56	1	0.1%
54	2	0.3%
52	2	0.3%
51	1	0.1%
50	2	0.3%
49	3	0.4%
48	4	0.5%

Insulin
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	180
Distinct (%)	47.2%
Missing	356
Missing (%)	48.3%
Infinite	0
Infinite (%)	0.0%
Mean	156.2650919

Minimum	14
Maximum	846
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	5.9 KiB

Quantile statistics

Minimum	14
5-th percentile	43
Q1	77
median	126
Q3	190
95-th percentile	392
Maximum	846
Range	832
Interquartile range (IQR)	113

Descriptive statistics

Standard deviation	118.8441951
Coefficient of variation (CV)	0.7605293904
Kurtosis	6.452059587
Mean	156.2650919
Median Absolute Deviation (MAD)	54
Skewness	2.173246634
Sum	59537
Variance	14123.9427
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
105	11	1.5%
130	9	1.2%
140	9	1.2%
120	8	1.1%
100	7	0.9%
180	7	0.9%
110	6	0.8%
115	6	0.8%
94	6	0.8%
66	5	0.7%
Other values (170)	307	41.7%
(Missing)	356	48.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
14	1	0.1%
15	1	0.1%
16	1	0.1%
18	2	0.3%
22	1	0.1%
23	1	0.1%
25	1	0.1%
29	1	0.1%
36	3	0.4%
37	2	0.3%

Value	Count	Frequency (%)
846	1	0.1%
744	1	0.1%
680	1	0.1%
600	1	0.1%
579	1	0.1%
545	1	0.1%
543	1	0.1%
540	1	0.1%
510	1	0.1%
495	2	0.3%

BMI
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	245
Distinct (%)	33.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	32.42890095

Minimum	18.2
Maximum	67.1
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	5.9 KiB

Quantile statistics

Minimum	18.2
5-th percentile	22.2
Q1	27.5
median	32.3
Q3	36.6
95-th percentile	44.26
Maximum	67.1
Range	48.9
Interquartile range (IQR)	9.1

Descriptive statistics

Standard deviation	6.902444669
Coefficient of variation (CV)	0.2128485538
Kurtosis	0.9148683966
Mean	32.42890095
Median Absolute Deviation (MAD)	4.6
Skewness	0.5936784499
Sum	23900.1
Variance	47.6437424
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
31.2	12	1.6%
32	12	1.6%
31.6	12	1.6%
33.3	10	1.4%
32.4	10	1.4%
30.1	9	1.2%
32.9	9	1.2%
30.8	9	1.2%
33.6	8	1.1%
32.8	8	1.1%
Other values (235)	638	86.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
18.2	3	0.4%
18.4	1	0.1%
19.1	1	0.1%
19.3	1	0.1%
19.4	1	0.1%
19.5	2	0.3%
19.6	3	0.4%
19.9	1	0.1%
20	1	0.1%
20.1	1	0.1%

Value	Count	Frequency (%)
67.1	1	0.1%
59.4	1	0.1%
57.3	1	0.1%
55	1	0.1%
53.2	1	0.1%
52.9	1	0.1%
52.3	2	0.3%
49.7	1	0.1%
49.6	1	0.1%
49.3	1	0.1%

DiabetesPedigreeFunction
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	503
Distinct (%)	68.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.4721085482

Minimum	0.078
Maximum	2.42
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	5.9 KiB

Quantile statistics

Minimum	0.078
5-th percentile	0.1418
Q1	0.245
median	0.376
Q3	0.624
95-th percentile	1.1166
Maximum	2.42
Range	2.342
Interquartile range (IQR)	0.379

Descriptive statistics

Standard deviation	0.3287749935
Coefficient of variation (CV)	0.6963970358
Kurtosis	5.805183303
Mean	0.4721085482
Median Absolute Deviation (MAD)	0.169
Skewness	1.9341047
Sum	347.944
Variance	0.1080929964
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.258	6	0.8%
0.254	6	0.8%
0.259	5	0.7%
0.207	5	0.7%
0.238	5	0.7%
0.268	5	0.7%
0.19	4	0.5%
0.27	4	0.5%
0.284	4	0.5%
0.26	4	0.5%
Other values (493)	689	93.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.078	1	0.1%
0.084	1	0.1%
0.085	1	0.1%
0.088	2	0.3%
0.089	1	0.1%
0.092	1	0.1%
0.1	1	0.1%
0.101	1	0.1%
0.107	1	0.1%
0.108	1	0.1%

Value	Count	Frequency (%)
2.42	1	0.1%
2.329	1	0.1%
2.288	1	0.1%
2.137	1	0.1%
1.893	1	0.1%
1.781	1	0.1%
1.699	1	0.1%
1.698	1	0.1%
1.6	1	0.1%
1.476	1	0.1%

Age
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	52
Distinct (%)	7.2%
Missing	14
Missing (%)	1.9%
Infinite	0
Infinite (%)	0.0%
Mean	33.32780083

Minimum	21
Maximum	81
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	5.9 KiB

Quantile statistics

Minimum	21
5-th percentile	21
Q1	24
median	29
Q3	41
95-th percentile	58
Maximum	81
Range	60
Interquartile range (IQR)	17

Descriptive statistics

Standard deviation	11.74423364
Coefficient of variation (CV)	0.3523854965
Kurtosis	0.6064216252
Mean	33.32780083
Median Absolute Deviation (MAD)	7
Skewness	1.118982471
Sum	24096
Variance	137.9270238
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
22	64	8.7%
21	57	7.7%
25	47	6.4%
24	44	6.0%
23	35	4.7%
28	34	4.6%
27	32	4.3%
26	31	4.2%
29	28	3.8%
31	23	3.1%
Other values (42)	328	44.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
21	57	7.7%
22	64	8.7%
23	35	4.7%
24	44	6.0%
25	47	6.4%
26	31	4.2%
27	32	4.3%
28	34	4.6%
29	28	3.8%
30	19	2.6%

Value	Count	Frequency (%)
81	1	0.1%
72	1	0.1%
70	1	0.1%
69	1	0.1%
68	1	0.1%
67	3	0.4%
66	4	0.5%
65	2	0.3%
64	1	0.1%
63	4	0.5%

Outcome
Categorical

HIGH CORRELATION

Distinct	2
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Memory size	5.9 KiB

0	477
1	260

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	737
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	0
3rd row	1
4th row	0
5th row	1

Common Values

Value	Count	Frequency (%)
0	477	64.7%
1	260	35.3%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
0	477	64.7%
1	260	35.3%

Most occurring characters

Value	Count	Frequency (%)
0	477	64.7%
1	260	35.3%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	737	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	477	64.7%
1	260	35.3%

Most occurring scripts

Value	Count	Frequency (%)
Common	737	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	477	64.7%
1	260	35.3%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	737	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	477	64.7%
1	260	35.3%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	df_index	Pregnancies	Glucose	BloodPressure	SkinThickness	Insulin	BMI	DiabetesPedigreeFunction	Age	Outcome
0	0	6	148.0	72.0	35.000000	NaN	33.6	0.627	50.0	1
1	1	1	85.0	66.0	29.000000	NaN	26.6	0.351	31.0	0
2	2	8	183.0	64.0	29.095969	NaN	23.3	0.672	32.0	1
3	3	1	89.0	66.0	23.000000	94.0	28.1	0.167	21.0	0
4	4	0	137.0	40.0	35.000000	168.0	43.1	2.288	33.0	1
5	5	5	116.0	74.0	29.095969	NaN	25.6	0.201	30.0	0
6	6	3	78.0	50.0	32.000000	88.0	31.0	0.248	26.0	1
7	7	10	115.0	NaN	29.095969	NaN	35.3	0.134	29.0	0
8	8	2	197.0	70.0	45.000000	543.0	30.5	0.158	53.0	1
9	10	4	110.0	92.0	29.095969	NaN	37.6	0.191	30.0	0

Last rows

	df_index	Pregnancies	Glucose	BloodPressure	SkinThickness	Insulin	BMI	DiabetesPedigreeFunction	Age	Outcome
727	758	1	106.0	76.0	29.095969	NaN	37.5	0.197	26.0	0
728	759	6	190.0	92.0	29.095969	NaN	35.5	0.278	66.0	1
729	760	2	88.0	58.0	26.000000	16.0	28.4	0.766	22.0	0
730	761	9	170.0	74.0	31.000000	NaN	44.0	0.403	43.0	1
731	762	9	89.0	62.0	29.095969	NaN	22.5	0.142	33.0	0
732	763	10	101.0	76.0	48.000000	180.0	32.9	0.171	63.0	0
733	764	2	122.0	70.0	27.000000	NaN	36.8	0.340	27.0	0
734	765	5	121.0	72.0	23.000000	112.0	26.2	0.245	30.0	0
735	766	1	126.0	60.0	29.095969	NaN	30.1	0.349	47.0	1
736	767	1	93.0	70.0	31.000000	NaN	30.4	0.315	23.0	0

Overview

Variables

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows